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1. Introduction 

Small world networks J\ have become popular models in a variety of areas in physics 
and mathematics [21 El lU 13 E] 5 as their architecture mimics that found in many real- 
world situations. Social networks, the world wide web, infra-structure networks, as 
well as networks in biology (neural networks, protein regulatory networks, etc.) are all 
thought to exhibit the 'small world effect'. This means that the average minimal path 
length in such a network is relatively small compared with the topological distance, 
due to the presence of long range 'short cuts'. This natural distance depends on the 
backbone of the graph, typically a one-dimensional ring, as in [Zj, where a spin glass on 
a small world network was studied. It was argued that this might be a model for RKKY 
type interactions in metallic spin-glasses. The short range interactions were uniformly 
ferromagnetic while the long range bonds were taken to be random. The randomness 
in the structure of the long range graph and the value of the long range interactions 
constitutes quenched disorder and was treated using replicated transfer matrices for the 
one dimensional ring j^j. Within this formalism, an Ising spin model was solved at a 
replica symmetric (RS) level of approximation, where the calculation of observables away 
from the paramagnetic phase required population dynamics algorithms. Although the 
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RS solution was a good first approach, it was anticipated that there would certainly be 
parameter regions for which the RS theory would not be sufficient and replica symmetry 
breaking would have to be taken into account, e.g. for vanishing values of the short range 
interactions where one recovers a spin glass on a random graph. 

In this paper we demonstrate how the cavity method can be applied to 'small 
world' models and extend the replica formalism solution of [7 to the one step replica 
symmetry breaking (1RSB) level. After introducing the model, we present the cavity 
method in RS approximation, for our 'small world' lattice and show the equivalence 
with the replica method. We then proceed with the 1RSB cavity calculation along 
the lines of P|, present the appropriate extension of the replica formalism (in terms of 
replicated transfer matrices) and show the correspondence between the two methods 
at the 1RSB level. Finally, we apply our theory to a point in phase space where the 
replica symmetric theory predicts zero magnetization but a non reentrant conjecture 
[TU] suggests that the magnetization order parameter should be nonzero. We find that 
this point displays a finite magnetization at the 1RSB level. Support for this finding is 
provided with simulation results. 

2. Model definitions 

Our model describes N interacting Ising spins <7j G {—1,1}, % G {1,..., iV}, in thermal 
equilibrium at inverse temperature f3 = 1/T, on a lattice consisting of a 1-dimensional 
ring to which we add random long range bonds at each site. The number of long 
range bonds ki at site i is distributed identically for each site according to the degree 
distribution p(k), the mean of which we denote by (k). For a Poisson distribution p(k) 
we recover the model of [Zj. The Hamiltonian of the system is given by 



with ctjv+i = <7\ and where and Cij are quenched random variables. The long range 
interactions J^- G 1R are independently drawn from a distribution pj{Jij), while the 
symmetric (cji = c^) dilution variables Cjj G {0, 1} are random, but obey the constraints 



Throughout we assume that Jo > 0, which is appropriate for investigating RKKY 
type interactions. It is expected that negative short range interactions could lead to 
a variety of complex phenomena such as first order phase transitions between multiple 
locally stable states or distributions of fields with fractal support (see e.g [11J), which 
would certainly be of interest from the point of view of complex systems but go beyond 
the scope of this paper. 



0~iO- i+ i - j— 
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3. The distribution of cavity fields at the RS level 

Throughout the following we apply a modification of the cavity method used to study 
the Bethe lattice in |5] and which, for the sake of compactness, we refer to for a 
detailed discussion of the method. To simplify the discussion we initially consider the 
case p(k') = 5k>,k i- e - the long range connectivity is fixed to the value k. Later we 
generalize to ensembles of graphs with arbitrary p(k'). 



3.1. Distribution of cavity fields for the Bethe lattice 



The idea behind the cavity method for the Bethe lattice at the level of replica symmetry 
is the assumption that the mutual statistical dependence of a set of spins, {o~i, . . . , o~k-i}, 
which all interact with a single common spin o"o, is due only to the spin <7o. Thus, a 
priori, their individual state statistics would be identical in the absence of that spin. 
The individual spin probabilities, when their link to Co is removed, (spins which miss 
one link are called 'cavity spins') can consequently be characterised by independent 
identically distributed effective local fields {hi, . . . , hk-i} where p(o~j) ~ eP h 3 a 3 . Self- 
consistent equations for the distribution of effective fields {hj} can then be found by 
linking the k — 1 cavity spins with cr , which is then itself a new cavity spin. The 
partition function of the new cavity spin is 



Z(a ) 



E 



cxp 



((Tl,...,(7 fc _ 1 ) 



fc-1 



k-1 



c 1 ({ J e}, {he}) exp 



fe-i 



f3a X u{Jz, hi 



with 



and 



u(Je,he) = — tanh 1 [tanh(/3J^) tanh(/3/^ 

P 



i{Ji},{hi})=E 2 



(3) 



(4) 



(5) 



cosh(/3w(J|, hi)) 

The RS assumption implies p(o~o) ~ e^ hocr ° , therefore we identify 

k-1 

h = J2u(J e ,h e ) (6) 
e=i 

as the cavity field of the new cavity spin a . Invariance of the distribution of effective 
fields under this graph operation (the linking to the new cavity spin) leads to the iterative 
equation for the distribution of cavity fields 

k—l 

W(h) = f 5[h - ]T u(J e , h)} (7) 
J i=i 

for a Bethe lattice with connectivity k. We have introduced the shorthand (to be used 
throughout the paper) = Y\^ =1 dh£dJiW(hi)pj(Ji). 
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Figure 1. Left: Cavity graph for k = 3 with 3 r-spins and 1 er-spin. This graph can 
be iterated by adding a cro-spin and connecting it with 3 long-range bonds (dashed) 
to the r-spins and 1 sort-range bond (solid) to the cr-spin. Right: Cavity graph for 
k = 3 with 2 r-spins and 2 cr-spins. This graph can be iterated by adding a ro-spin 
and connecting it with 2 long-range bonds (dashed) to the r-spins and 2 short-range 
bonds (solid) to the cr-spins. 



3.2. Distribution of cavity fields for the small world lattice 

The key difference when applying the cavity method to the small world lattice, is that 
there are now two different types of cavity spin. Either one can remove a short range 
bond, or one can remove a long range bond. A cavity spin with one short range bond 
and k long range bonds will be denoted by a and a cavity spin with two short range 
bonds and k — 1 long range bonds by r. The assumption of the cavity method at the 
level of RS is now that all cavity spins of type r have identical individual statistics, as 
have all cavity spins of type a. The single spin probabilities are parametrized by 

p(Tj) ~ p(aj) ~ e^°* (8) 

and it is assumed that the distributions of the different effective cavity fields W(h) and 
are invariant under the appropriate graph iterations. These graph operations are 
illustrated in figure The left figure denotes the set of cavity spins, which for a small 
world lattice with k = 3, can be linked onto a new a cavity spin, the right shows spins 
which can be linked onto a new r cavity spin. By considering the partition functions of 
the new cavity spins analogously to (|5]L one may again identify the new cavity fields 

k 

x = u{J ,Xi) + J2 u ( J t/( k )i h e) 

fc-i 

ho = u(J , xi) + u(J , x 2 ) + u ( J e/ ( fc )> h t) ( 9 ) 

t=i 

giving the set of coupled equations 

k 

$(x) = f dx'$(x')D k 5[x-u(Jo,x')-J2<Je/(k),he)} 
J (= i 
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W(h) = f dx 1 dx 2 $(x 1 )$(x 2 )D k _ 1 8[h - u( J , Xl ) - u{J , x 2 ) - u(J e /(k), h f )} (10) 

Thus an x cavity field receives one message along the spin chain and k long range 
messages, while an h cavity field receives two messages along the chain and k — 1 long 
range messages. 



4. Calculating replica symmetric observables 

To calculate observables with the cavity method, various operations on cavity graphs 
can be defined. In some cases these operations are not unique, however, the results they 
give are equivalent. 



4-1. The total free energy 

We define the GN, qi ,q 2 cavity graph to be a graph consisting of iV spins, where q\ of 
these are cavity spins of the a-type and q 2 are cavity spins of the r-type. In particular, 
consider a GN,4,2k graph. By adding 2 short range bonds and k long range bonds, the 
latter can be converted into a Ga^o graph, whereas, adding 2 sites (and connecting 
each of them with 2 short range and k long range bonds) creates a GV+2,0,0 graph. If 
adding two short-range and k long range links results in a free energy shift AF^ and 
adding a site with its 2 short range and k long range links results in the free energy shift 
Ai^ 2 ) , the total free energy per spin of the small world lattice is 

/ = lim \ [F(G N+2J0fl ) - F(G NA0 )\ 



= AF( 2 ) - -AFW (11) 
2 v ; 

where denotes averages over the quenched disorder. Expressions for the free energy 
shifts AF^ and AF^ 2 ^ are obtained from the difference in the logarithm of the partition 
sum before and after the graph operation: 

- PAF& = 2 log[cosh03Jo)] + £ log[cosh(/3J,/(A;))] 

e=i 

+ log[l + t&nh((3u( J , xi)) tanh(/5x 3 )] + log[l + tanh(/3w( J , x 2 )) tanh^a^)] 

k 

+ $>g[i +t&nh(p U (J e /{k),h e ))t^h(ph k+e )} (12) 
l=i 

-f]AF< 2) = log { j + V log! <~MW<*» | 

[cosh(/3u(J ,^i)) cosh(f3u(J , x 2 )) J fr{ { cosh.(/3u(J e /(k), hi)) J 

k 

+ log 2 cosh P(u(J ,xi) + u(J ,x 2 ) + J2u(J e /(k), hi) (13) 

e=i 

It follows that the total free energy per spin on a graph with long range fixed connectivity 
k is given by 

Pf = - log2 - log[cosh03J )] - ^(\ogcosh(pj e /(k)))j 



k 

+ 2 
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+ J dxdx'$(x)$(x') log[l + tanh(/3J ) tanh(/3x) tanh(/3x')] 
+ 2 Jdx^(x) logcosh(/3-u(J , x)) 

/ d/id/i'W(/i)W(/i , )(log[l + tanh(/3J/(Jfc» tanh(/3/i) tanh(/3/i')]> J 
+ A; y" d/i W(^)(logcosh(/3u(J/(ib), 
- y d/idxdx' logcosh(/3/i)$(a;)$(a; , ) J Dfe 

x S[h-u(J ,x) -u(J ,x') -J2 u ( J e/{k),h e )} (14) 

where we have abbreviated (/(«/)) j = fdJpj(J)f(J). We note once more that one 
can define different sets of graph operations, which lead to different formulations of 
equivalent expressions of the free energy. 

4-2. Magnetizations, correlations and graph iterations 

To calculate the magnetization and spin glass order parameters, the effective field of a 
normal spin is needed, as opposed to a cavity spin. To that end, k long range and 2 short 
range bonds are linked with a new site, which then has the correct set of neighbours. 
Its real effective field distribution follows once the cavity field distributions are known, 
giving 

m= JdH R{H)ttmh{(3H) (15) 
q = JdH R(H) tanh 2 (/3#) (16) 

where 

R(H)= fdxdx'^(x)^(x')D k 5[H-u(Jo,x)-u(J ,x')-J2 u ( J e/(k),he)} (17) 
J e=i 

To calculate the nearest neighbour correlation function on the ring 

^ = J™^£(^> ( 18 ) 

i 

one can link two o cavity spins by a short range bond of strength Jo. The Hamiltonian 
giving the partition function of the two spins is defined by 

H(a u cr 2 ) = -( J o"iO"2 + X\Cf\ + ^2^2) (19) 
The ensemble averaged nearest neighbour correlation function follows: 

C = fdxdx' *( X )*V) ; anh(/ ^ ±, ^f'^l (20) 
J y ' y ' 1 + tanh(/3 J ) tanh(/3x) tanh(/3x') v ; 

Although giving more cumbersome expressions, other higher order correlations may be 
calculated in a similar way. 



Replica symmetry breaking in the 'small world' spin glass 



7 



Anticipating later calculations, we write down expressions for the free energy shifts 
resulting from adding a o cavity spin to the graph or adding a r cavity spin to the 
graph. These free energy shifts will be important at the level of 1RSB: 



/3AF CT = log 



cosh(/5J 



cosh(/3w( J , Xi)) 



and 

- (3AF T = log 



+ log 2 cosh 



cosh 2 (/?J 



cosh(pJ e /{k)) 
cosh((3u(J e /(k),h e )) 



P(u(J ,Xi) + J2u(J e /(k),h e )) 



(21) 



fc-i 



cosh((3u( Jq, xi)) cosh((3u(Jo, X2)) 



coak(J3J t /(k)) 
cosh((3u(J e / (k),hi)) 



+ log 2 cosh 



fc-i 



P(u(J , xi) + u(J , x 2 ) + u ( J e/ ( k )i h e)) 

1=1 



(22) 



5. 'Small world' lattices with fluctuating connectivity 

5.1. Arbitrary long range connectivity distribution 

We now return to the case of arbitrary connectivity distribution p(k). The only 
modification is that we must now average over the ensemble of graphs, described by 
their connectivities p(k), for the different graph iterations. For the iteration of a r 
cavity graph, one should take into account the degeneracy, i.e., for a given k there are 
k different ways to remove one link, and thus each cavity graph with fc-1 r spins is to 
be weighted by an additional factor k. After normalisation one finds for the cavity field 
distributions 

. 00 k 

$(x) = J dx' $(x')Y,P(k)D k 5[x - u(J ,x') -^u(J t /(k),h t )] (23) 



fc=0 



W{h) 



dxdx' ®(x)$(x') £ ^TT^ D k- 



k=0 



(k) 



k-1 



x 5[h - u(J , x) - u(J , x) - Y u(Je/ (k), hi)] 



(24) 



Similarly, the free energy (|T4*|) can easily be generalised to the case of a general p(k). 

The self-consistent equations for the distributions of the cavity fields admit the 
trivial solutions W(z) = $(z) = $(z). At high temperature these are the only solutions 
and they describe a paramagnetic state. Second order transitions to ferromagnetic 
or spin glass phases can be found along the lines of [7j, by expansion in small 
moments around the paramagnetic solution. Bifurcations of Jdh W(h)h and fdx&(x)x 
correspond to a transition into the ferromagnetic phase. This will occur at the critical 
temperature solving 



1 



(k)(e 



2/3J 



1) + 



(k 2 ) - (k) 
(k) 



( tanh (w, 



(25) 
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Similarly, a spin glass phase appears when one of the second moments JdhW(h)h 2 or 
Jdx $(x)x 2 bifurcates, given by the condition 



2(k}smh 2 ((3J )+ {k2) {k) {k) 



5.2. Correspondence with the replica method 



tanhM^M (26) 



For models where the number of long range connections at a given site is Poisson 
distributed, i.e p(k) = e~ c c k /k\ one finds that J2kP(k)kf(k — l)/(k) = J2kP(k)f(k). 
We can exploit this property and recover the results of [7] obtained with the replica 
approach. In particular, the replica symmetric order parameters are the distributions 
^{y), W(h) which are the solution of the following coupled equations: 

<J(x) = / dx' 4>(x') £ ^~D k 8[x - £ u(J e /c, h e ) - u(J , x')] (27) 



k t=l 
-cJk 



9{y)= [dy f ^y')J2^Dk5[y-u(Jo,y' + J2u(J e /c,h e ))] (28) 
J k i=i 

W(h) = Jdxdy$(x)V(y)6[h-x-y] (29) 



We can immediately see that (|27j) is exactly the same as the equation of the distribution 
of the x-type cavity field (J2BJ)- To verify that W{h) in (|2T)j) is the distribution of the 
cavity fields of type h, we first note the following relation between $ and 

— c k k 

^HE^TT f<lyy(y)D k 5[x-y-J2u(Je/c,he)} (30) 
k K - J i=\ 

which can be easily verified by inserting this expression for $ in (J27|) and then using (J28)) . 
Upon substituting \I/ in the right-hand side of (|2~9"j) with (J2ZJ), (|2^j) and introducing 
the shorthand p k = e~ c c h /k\ we get: 



W(h) = [dx'dx"$(x')\j2 [dy'*{y')D k , 5{x" - y' - ^u{J v /c,h e )] 

x YjPk j D k 5[h-u{Jo,x') -u(J ,x") -J2u(J e /c,h e )] (31) 



From (|30|) it follows that the expression in the curly brackets above is $(x"), therefore 
we get the same equation for the field h as from the cavity approach (given the 
Poisson distribution of the long range connectivity). Thus we conclude that the cavity 
field distribution W{h) is identical to the effective field distribution W{h) (defined 
via W(h) = linijv^oo jj Y.i 5[h — tanh _1 ((cri))]) on the Poisson random graph. This 
correspondence between the two methods also provides a nice physical interpretation 
of the n — > limit of the eigenvalue problem of the replicated transfer matrix of the 
replica approach described by equation (|2*7j). The right n — > eigenvector, associated 
with the largest eigenvalue is the type x cavity field distribution. 
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Finally let us comment that when the free energy (|14|) is generalized to the case of 
a Poissonian connectivity, the self-consistency equation for W(h) can be inserted 
into the last term to give 



It is then straightforward to verify that this expression is equivalent to the result in [7j. 
6. 1RSB cavity solution of the 'small-world' spin glass 

Considering that the model we have described so far is still general in allowing an 
arbitrary site-independent connectivity distribution p(k) and distribution of interaction 
strengths pj(J) $ , it is beyond doubt that cases in which replica symmetry is broken 
are within the possible parameter regimes. An example is the case where p(k) = 5k } e, 
Pj(J) = \8{J — 6) + |<5(J + 6) and Jo = 0, exactly the Bethe lattice spin glass studied in 
[Oj (note that we have rescaled the fields in our model definitions). Having formulated 
the replica symmetric solution of the model on the small world lattice using the cavity 
method, we proceed by applying the formalism explained carefully in ||, in order to 
derive results at the level of 1RSB. Since the generalization of the 1RSB cavity method 
for the Bethe lattice to the small world lattice is straightforward once the RS results are 
known, we will just briefly give the resulting 1RSB equations for the small world lattice 
and discuss the differences with the Bethe lattice. 

6.1. Basic assumptions of the 1RSB formulation 

Instead of assuming that the state with the lowest free energy, characterised by W(h) 
and is invariant under cavity graph iterations of any kind, at the level of 1RSB 

one considers the M. locally stable states of lowest free energy. At a cavity site i, one 
defines the effective cavity fields hf or xf, where a G {1, . . . , Ai} labels the particular 
state. To each state a a free energy F a is associated. The crucial point is that upon 
a graph iteration each pure state a receives a different free energy shift AF a , which 
is a function of the {h?} and {x"} being linked to the new site. The ordering of new 
free energies of the different states after a graph iteration need not be the same as that 
before. The distribution of free energies is postulated to be of the form 



| Of course the distributions should be sufficiently well-behaved to give a well-defined free energy 




p(F)=ex P (P f i(F-F r ^)) 



(33) 
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(34) 



and the likelihood W a for the system of being in a state a is given by 

exp(-/?F°) 
" E 7 exp(-/3F7) 

The distributions of the different cavity field distributions are assumed to factorize over 
pure states at each site in the following manner: 

i M 

p ( h )^En# a ) ( 35 ) 

JV i a=l 

qw = ^eiiw (36) 

JV i a=l 

Similarly, one can define the distribution of effective local fields on a normal (non-cavity) 
spin: 



1 M 

o(H) = -£n^o?n 

JV i a=l 



(37) 



Then the cavity and effective field distributions for a pure state are reweighted by the 
free energy shifts upon a graph iteration: 

Po(h ) = Cp 1 J d(AF T ) W(h , AF T ) exp(-/^AF T ) (38) 
j 1 J d(AF a ) $(x , AF a ) exp(-(3fiAF a ) (39) 

r d(AF (2) ) R(H , AF (2) ) exp(-/^AF (2) ) (40) 

Here W(h ,AF T ), $(x ,AF ff ) and R(H , AF (2) ) denote the joint distributions of fields 
and free energy shifts. Since one has 

ua h a (h a h a •y a t q T T \ 

Uq — Uq {11^ , . . . , J^i , ^2 J J 1l ■ ■ ■ ) u k—l) 

AF r a = AF?(h a 1} . . . , hU, <, a£, ^i, • • • , Jk-i) 



Qo{x ) 
Oo(H ) 



c; 



x ~ x (^1 ) • • • J fyfc i X l ' • • • ' "^fc) 



(41) 



AF CT a = AF CT a (/i?,...,/i£X,J 1; ...,J fc ) 

i?Q = if (/i 1 , . . . ,h k ,x 1 ,x 2 , J\i ■ ■ ■ , </fc) 

AF« a = AF« B (/i? > ... > /iJ ) rr?, a ^,J 1 , 

these joint distributions are obtained by linking the appropriate sets of cavity spins in 
the same pure state a onto a new spin. 

Alternatively, one could formulate the iteration of distributions in terms of 
iterations of functionals and W[{P}], representing functional densities of the 

distributions (JHS|) and J3HJ), giving 



IP w 



1 



dz'Q'^Ont/d^K^)] 



e<k 



x5 



x - u(J ,x) - u ( J i/ i k )i hi) 

Kk 



(42) 
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W\{P}] = Y.T^ jW}W}n{QW\{Q'}} II [J{dPe}dJ e W[{P e }]pj(J e ) 



(k) 



e<k-i 



1 



l[8{P(h)-—jdxdx'Q(x)Q'(x > ) J] [ldhiP t (hi)] 



e<k-i 



x 5 



h - u(J ,x) - u(J ,x') - u(J e /(k),h e 

e<k-i 



where Cn,Cp are normalization constants. 



(43) 



6.2. Observables in 1RSB formulation 

Numerically solving the 1RSB equations can be achieved with a population dynamics 
algorithm. The distributions ([HHEEEH) are approximated by Af populations of M. 
fields. The result of a sufficient number of iterations of these M populations is a 
stochastically stable set of populations of fields. The various observables are found 
from these populations of fields via the following equations: 



m 



— ^tanh(^) 
gi = -^£tanh 2 (/3iP) 



M{M _ X) £ tanh(^ Q ) tanh(/?^) 



(44) 
(45) 
(46) 



/ 



2/?/i 



In 



^exp^Ai^) 



-J- In 



(47) 



Note that in the above expressions, AF^ and AF^) are functions of the fields {hf} and 
{xf }, as well as { Jj}. The final results are understood to be averages of many samples 
from the populations of fields and distributions pj{J). The parameter \i corresponds to 
the fraction of overlaps equal to go and should thus have a value between and 1. The 
correct value is found by extremization of the free energy. Thus the right value of fi is 
the one for which the derivative of the free energy with respect to /x is zero. The latter 
is expressed as 



where 



and 



df 



2 



?*— = zij?(D + l S a exp(-^AFW)AFj 1 ) 
dn H fi E Q exp(-/3 y uAFi 1) ) 



dF^ = -l p{2) + l E Q exp(-^AF( 2 ))AF( 2 ) 
dfi fi y. £ Q exp(-/3//AFi 2) ) 



(48 



(49) 



(50) 
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By defining the free energy shift of a short range linking of two cr cavity spins 

-PAF? = log expi-PHfaafrf,^)} (51) 

one may write the expression for the nearest neighbour correlation function as 

V PYrJ fin AF a ] tanh (/ 3J o)+ tanh (/ 3a: i )tanh(/3xf) 
^ l^a^Pl Fh L '-*' r b \ l+tanh(/3Jo)tanh(/3s«)tanh(/3a;«) 

= E Q exp[-/3/iA^] ( j 

7. 1RSB replica solution of the 'small- world' spin glass 

7.1. General remarks 

In this section we consider the spin glass model on a 'small-world' lattice with a Poisson 
distribution for the number of long range connections at a given site. This model was 
studied with the replica formalism in [7] , where phase diagrams where derived using the 
replica symmetric ansatz. The basic ingredients of this approach are the the 2 n x 2 n 
replicated transfer matrix T[P] with entries: 

T aa \P\ = eC^Er^Xe^V (53) 

and the order parameter function P(t), which in the limit N —>■ 00 gives the fraction of 
the n-replicated spins <Xj = (crj, . . . , cr") with a given configuration r G {—1, 1}™, and 
satisfies the self-consistent equation: 

1 ' £<r«<r[JW] 
where v[P], u[P] are the left and right eigenvectors associated with the largest eigenvalue 
of the replicated transfer matrix T[P]. 



7.2. Eigenvalue problem for the 1RSB replicated transfer matrix 

We consider the first step of Parisi's replica symmetry breaking scheme [13], according 
to which the n different replicas are divided into n/m blocks of m replicas and in the 
limit n — > the integer m becomes a real number between and 1. In finite connectivity 
models this results in the order parameter function P(cr) acquiring the form [T5] : 

Pi.) = /{dP} W l{ P }] n /dfc P(fc) p^^^ (55) 

The physical interpretation of the functional W[{P}] is similar to that of the replica 
symmetric function W(h). In particular one considers effective fields defined via = 
4 arctanh(crj)Q,, but in contrast with the RS case the existence of different pure states 
or ergodic components (denoted by a) is now taken into account. The effective field, at 
a given site i, fluctuates due to the presence of different pure states. If the probability 
distribution of this field is Pi(h) then this distribution will generally be different from 
site to site, therefore the relevant order parameter is the functional probability measure 
W[{P}] of those densities. Insertion of (|H5|) in the general expression for the replicated 
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transfer matrix (|53|) leads, after some straightforward manipulations, to the following 
expression for the 1RSB replicated transfer matrix: 

n/m 

T%%? = {dM}V[{M}\ J] /d^M(^|m)e /3J °S™i^.< i +/ 3e E: =1 ^ ( 56 ) 
J 1=1 J 

where the shorthand V which will be used in the remainder of this section is defined as: 

-e k 



V[{M}] = E II { / MtPj(Jt){dPt} W[{P t }] 



{k 
M{9\m) - f[ 

with 



r dluP^H) 1 ^m^BWcM) 5[e _ T,u(Jt/c,hi))\ (57) 
J [2cosh(/3h e )] m [ £i y 1 ' n I v ; 



B(J,z) = ^log{4cosh[/3(J + z)]cosh[/3(J-^)]} 

We observe that with each of the n/m blocks (labeled by I) a different 2 m x 2 m matrix 
is associated. This may be viewed as a transfer matrix of a one dimensional chain 
with random fields 9. Note however that M(6\m) is not normalized (as would be the 
case in a purely ID model). The complete matrix consists of the n/m- fold Kronecker 
product of the 2 m x 2 m matrices averaged over the functional measure V, which gives 
the probability of drawing a particular 'distribution' of random fields M(6\m). 

We proceed as in the replica symmetric approach and introduce an ansatz for the left 
and right eigenvectors associated with the largest eigenvalue of the replicated transfer 
matrix 1)56)1 which is the natural generalization of the replica symmetric eigenvectors 
(see e.g 0,0) 



..1RSB 

UifT 



,1RSB 



n/m ePxEZi^l 



i=i 



jmvm\n\J[j A vm , 2cosmMm (59) 



1=1 



where 0(x) ,ip(y) are assumed to be normalized. Insertion in the eigenvalue equations 
(to be satisfied for every cr): 

ST^ T 1RSB 0I 1RSB _ -v \ lRSB „ARSB T 1RSB _ x f^^lRSB 

1 <J<y' "(T' - MRSBynjUfj. 2^ v cr' I ercr ~ ^irsbK^v^ 

cr' 



leads to new eigenvalue problems for the functionals [/[{</>} V[{^}|n]: 

XiRSB(n)U[{<P}\n] = f{d(l>'} A v {(l>, <t>'\n)U[{(l>'}\n] (60) 



XiRSB(n)V[W\n] = J{df}A v (^,ij'\n)V[m\n] (61) 

where 

A c/ (0,0»= ({dM}V[{M}}X[5[<P(x)-A u (x } <P'\M)][\(m\<P\M)\ n,m (62) 
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Au(x,<j>'\M) 



Jdx'dO (f>'(x')M(e\m) ifSg^p [2 cosh(/fr)]™ S[x - 6 - u{ J , x')] 



\(m\4>',M) 



n/m 



fdy'dO ^(y')M(9\m) ffgff [2 cosh(/%)r% - u(J 0} y' 



A V (^P, ^\n) = {dM} V[{M}} J] 6[,f>(y) - A v {y, if>'\M)] \X{m\^' , M) 



AvM'\M) 



and 



A(m|V',M)= UyA v M'\M) 



X(m\ip\M) 
X(m\<f>',M) = / dxA v {x,(j)'\M) 



(63) 
(64) 

(65) 
(66) 



7.3. Self- consistent equation for the 1RSB order parameter 

To find a self-consistent equation for the 1RSB order parameter (|55|) we only need to 
inspect the n — > limit of the eigenvalue problems (j60p61j) which are coupled via the 
^[{P}] dependence of P[{M}]. For the free energy however, we also need to know the 
0{n) term of the eigenvalue Xirsb(iT')- As in the RS case [7], we can see by setting n = 
in (16016 116 2l64j) . integrating over and using f{d(j)} U[{<p}\0] = J{dip}V[{i/j}\0] = 1 
(since [7[{0}|O], V[{/0}|O] represent probability measures) that: Xirsb(Q) = 1- This 
in turn implies that the n = functionals (which from now on we denote simply by 

^[ML^tMD are g iven b y : 

U[{4>}]= j{d4>'}U[{4>'}\ J {dM} V[{M}] Y[ 5 [<p(x) - A v {x, 0'|M)J (67) 

V[{4j}] = lW}V[W}\ [{dM}V[{M}}l[5U>(y)-Av(y,^\M)} (68) 

y 

These equations may be viewed as population dynamics equations for populations 
of distributions 4>(x),i/}(y), which are distributed according to £/[{0}], V[{/0}], with 
functional update rules Au,Ay- Note that the defining properties of a probability 
distribution, viz. non- negativity and normalization are preserved by the update rules 
as they should be. 

Furthermore, in the limit n — > insertion of ()55|58|59j) in (}54*|) results in: 



W[{P}]= /{d0}{d^}f/[{0}]l^}] 

[2 cosh((3h)] r 



xTT* 

h 



P(h)~ 



with the normalization constant 



Ch{<t>,^)= dxdy<f>(x)ij)(y) 



dxdy (j){x)ip{y) 
[4 cosh(/5a;) cosh (/??/)] 

cosh(/3x + (3y) 



S(h — x — y) 



(69) 



(70) 



2 cosh(/3x) cosh(/3y) 

The final triplet of coupled equations (|67I68I69|) determines the functionals U, V, W 
which play the role of 1RSB order parameters. 
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Scalar observables such as magnetization, spin glass order parameters etc, can be 
expressed as averages over P(cr): 

m = Y^ P(<T)o~a Qab = -P( cr ) "aO"6 (71) 

cr cr 
Note that (|B3j) encodes, at the 1RSB level, the hierarchical structure of the set of pure 
states which is inherent in the Parisi solution of the infinite range spin glass. Replicas 
within the same block / G {1, . . . ,n/m} are assumed to be in the same pure state, 
therefore the inter-state overlap q\ = limA^oo J2i (°"i)a i s f° un d from (J7TJ) with spins 
cr a , (Tb belonging to the same block I: 

q l = J{dP}W[{P}} JdhP(h)tanh 2 ((3h) (72) 

All different pure states belong to the same cluster, and the overlap between any two 
different pure states defined as q ai = liniAr^oo J2i (o~i)a(o~i)-y, is the same. This is 
obtained from (|71|) with spins o~ a , belonging to different blocks I ^ I': 



q = J{dP}W[{P}] 



dhP(h) tanh(/3/i) 



2 



(73) 



7.4- Derivation of the 1RSB free energy 



The general expression of the disordere-averaged free energy per spin in terms of the 
order parameter function P(cr) is: 

/ = lim J-{£ £ P(cT)P(cr')(e^' - 1> J - log A(n; P)} (74) 
n^o f3n 1 2 ( ^ T , J 

where A(n; P) is the largest eigenvalue of the replicated transfer matrix (|53|). To find 
the first contribution in the 1RSB solution, we insert (J51)j) into the above and work out 
the double replicated spin summation. In the limit n — » we get: 

lim n ^ E P(<T)P(<T'){e^™'-l) =-f - /{dP}{dP'}W[{P}]W[{P'}] 

x ^log ( J dhdh' P(h)P'(ti) cosh m (^) [1 + tanh(^) tanh(/3/i) tanh(/3//)] m ) J (75) 

The second contribution to the free energy involves the largest eigenvalue of the 1RSB 
replicated transfer matrix ()56j) . We have already seen that Xirsb{0) = 1, therefore for 
small n we have: \\RSB{n) = l + n\ + 0(n 2 ), which in turn implies that the contribution 
of the eigenvalue to the free energy in the limit n — > is — 4. To find A note that from 
(Ifi0lfi2j) follows: 

/{d0} U[{cj>}\n] J{dM} 7>[{M}]e£ "« *H*,m) 

XlRSB{n) = M« (76) 

We then expand the right-hand side around n = to find the 0(n) term. After some 
straightforward manipulations and using ()57I66|) the second contribution to the 1RSB 
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free energy becomes: 

- = - Iog2cosh(/3J ) + -L J{d<f>} f/[{0}] 2 



e c 



n 



x log < / dx (f>(x) Yl 



dhe Pe(hi) cosh r ' 



dJ4dP,}^(^)w[{^}] 



(- n [1 + tanh(— ) tanh(^)] + ~ [J [1 - tanh(— ) tanh(/3^)A 



x 



1 + tanh(/3x) tanh(/?J ) tanh[/3 2J u(Jt/c, hi)) 



(77) 



The final result for the disordered-averaged free energy per spin is the difference of the 
two contributions ((75)1. ((77)1. To determine the order parameter m (not to be confused 
with the magnetization) we must extremize the free energy with respect to m. In the 
limit n — > 0, m (which becomes a real number in [0, 1]) may be viewed as the probability 
of two configurations belonging to different pure states. 

Finally, let us mention that one can easily recover the RS expressions from the 
1RSB framework. In particular, the replica symmetry assumption corresponds to the 
system having one pure state or ergodic component. This implies that the effective field 
distribution at a given site becomes a delta function Pi(h) = 5{h — hi) and the order 
parameter is the distribution W(h) of the effective fields. Equivalently, the functional 
W[{P}] becomes: 

W flS [{P}]= fdhW(h)l[5[P(h)-5(h-h)] (78) 

h 

Similarly, for the right and left eigenvector functionals C/[{0}], ^[{V}] we have: 
U RS [{(p}} = [dx J] 5 [<j)(x) - 8(x - x)] 



V RS iW] = / dy *(y) J] 8 my) - S(y - y)} 



(79) 



Upon inserting these replica-symmetric functionals in ((67168169)) and setting m = 
(which also expresses the existence of one pure state), we find that W, $, $ satisfy the 
triplet of replica symmetric equations 



7.5. Correspondence with cavity approach 

As expected, the assumptions invoked in the 1RSB setup of both the cavity approach 
and the replica formalism describe exactly the same physics of the ultrametric structure 
of the ergodic components. In particular, for systems with a Poisson distribution of long 
range connections at a given site, the functional order parameters £7[{</>}] and M^[{P}] 
of the replica formalism satisfy the equations of the cavity method expressed in the 
functional form of ()42 ) 143 )1 . Upon using the identity 

cosh(/3J) 



(3B(J, z) - log 2 cosh(/3^) = log 



cosh(/3w( J, z)) 



(80) 
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= [2 eosh(fe)]» 35 1 [2 J t 2 C ° 3h|/3 " ( J °' 10 + ^ " ( J ' /C ' "'"I <81) 

After substituting the shorthand (}5Tj) into the self-consistent equation (JBTj) we see that 
with the simple correspondence: 

H - m F[Q] - [/[{</>}] Cq 1 - A(m|0, M) 

it becomes identical to (J22J)- To complete the correspondence between the two methods, 
we need also verify that W[{P}] given by (jHEJ) satisfies the second equation of the cavity 
method (|4*Hj) . To this end we will use the 1RSB analogue of (|3T)|) which relates the RS 
left- right eigenvectors of the replicated transfer matrix. The appropriate generalization, 
using the shorthand f)57j) . can be written as: 



U[{<j>}]= {diP}{dM}V[{i;}]V[{M}] 



IP 



, [2cosh(/?x)] m f dydei>(y)M(6\m) xf _ 



(82) 



^-«ft^'r <■»> 



x 

with the normalization constant: 

•dyd6ip(y)M(6\m) 
[2 cosh(/3y)] r 

Although here the algebra is more complicated, this can be shown in a straightforward 
manner, similar to the RS case in section I5~2*l by inserting the expression for £/[{</>}] in 
(jnZj) and then using (Jfi8~|) . We next insert (fHTj) and (jHEJ) in the right-hand side of (jHEJ) 
and use (J%2~|) to simplify the resulting expression, to find: 



W[{P}] = /{d^WKdM} U[{<P}}U[{<P ! }}V[{M}} J] J^CO - -M^> h <f>'\ M )] (W) 
where 

. . . . [2cosh(/3/i)] m /•dxdx , d^0(x)0(x')M(^|m)e /3mB ( Jo ' a; ) +/3mB ( Jo ' a; ') 

A w {h,(p,<p \M)- • 



C h (<f>,<//,M) J [4cosh(/3a;)cosh(/?x')] m 

x S[h — 6 — u(J , x) — u(J , a/)] (85) 



C h {<j>A\M) 



dxdx'd6(p(x)(t)(x')M(e\m)^ mB{ - Jo ^ + ^ mB ^ x ^ 



[4 cosh(/3a;) cosh(f3x') 
x [2 cosh(/30 + (3u(J , x) + (3u(J , x'))] m (86) 

With P[{M}] as in (|5Tj) this result is the cavity equation (pIHJ) . since properties of the 
Poisson distribution enable us to set in the latter J2k kPkf(k ~ — * J2kPkf(k), and 
we also have 



c 



e /3/iS(J ,a;i)+/3/i_B(Jo,a;2) 

[4 cosh(/3xi) cosh(/3a;2)] 



n 



^=1 



e /3nB(J e /c,h e ) 

[2 cosh(/3/^)]' 



2cosh(/5u(J ,a; 1 ) +/5u(J ,a; 2 ) + /3^u(J £ /c, ^))J (87) 

We conclude that for 'small- world' models with Poissonian long range connectivity, as 
expected, the cavity fields are equivalent to the effective fields introduced in the replica 
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Figure 2. Phase diagram, with left to the triple point (circle) the P — > SG transition 
line and to its right hand side the P — > F transition. Our population dynamics 
procedure concentrates on the point marked by a cross 

formalism. We note that this correspondence can be generalized to the case of an 
arbitrary connectivity distribution by exploiting the techniques used in [T51 HE] in the 
replica approach. 

8. Numerical results 

In |Zj phase diagrams were displayed for Poissonian connectivity distributions of average 
c and long range interaction distributions Pj(J) = p6(l — J) + (1 —p)5{\ + J) for various 
values of p and c. In line with physical reasoning ^0] and experience with other spin 
glass models (e.g. the SK model [T7j) it is assumed that the spin glass to ferromagnetic 
boundary is parallel to the temperature axis, i.e. it is inferred that no reentrance occurs 
for decreasing temperature. In the SK model, this is correct only at the level of full 
RSB, whereas, for the replica symmetric approximation one does find reentrance. Thus 
in RS there is a region of the spin glass phase which in reality (in full RSB theory and 
simulations) corresponds to a mixed phase with non-zero magnetization, implying a 
clear difference between RS and RSB results. To test our 1RSB theory, we have applied 
it to a model similar to the one in but with fixed connectivity. Unfortunately 
the fluctuations in the population dynamics algorithms we use (for a tolerable CPU 
cost) caused by a non-peaked connectivity distribution are found to severely limit the 
accessible accuracy in the value of /i. 

The P — ► F and P — > SG phase transition lines in the RS phase diagram for the 
model with p{k) = 5 fc6 , Pj(J) = §5(J — 1) + |(J + 1) are found by solving equations 
(J25J) and (J2fijl numerically. We have plotted the phase diagram in figure 121 

A non-reentrant phase diagram would suggest that the SG — > F transition line runs 
vertically down from the triple point, so would be fully determined by the corresponding 
value for J . We have attempted to find support for this conjecture, by concentrating on 
a point within the ordered region of the phase diagram, which RS population dynamics 
predicts is just outside the ferromagnetic phase. If for this point Jo is larger than the 
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Figure 3. Left to right: we plot the magnetization (to) against the number of updates 
per spin in simulations with N = 2000, N = 10 000 and N = 50 000 spins. The black 
lines show the magnetisations averaged over 10 observations, with one observation 
every 50 updates per spin. The white lines are averages over 2000 observations. As 
expected the fluctuations in the magnetization decrease with system size. Note the 
large change in the magnetisation for N = 50 000 system after w 6 x 10 6 updates per 
spin, suggesting that the system has not equilibrated yet. 



Jo corresponding to the triple point, one expects a nonzero magnetization at a certain 
level of RSB. 

For T = 0.2, the maximal value of Jo for which the RS population dynamics 
algorithm predicts a zero magnetization is approximately Jo = 0.15. Corresponding 
values of other observables are 

/ = -0.3561 and q = 0.5789 (88) 

The triple point is at J = 0.116, and thus the correct magnetization is not expected to 
vanish. 

Running the 1RSB population dynamics algorithm at this point in the phase 
diagram for different fi, we found that for /i = (0.31,0.32,0.33) the values of dF/d/i 
are (3.7 x 10 -5 , —0.5 x 10~ 5 , —1.3 x 10~ 5 ) respectively We conclude that the correct 
value for fi (where dF/dfi intersects the zero-axis) is jj, — 0.32 ± 0.01. For a system of 
M = 2000 and M = 1000 we find the results 

/= -0.3557 ±0.0001 and q = 0.397 ± 0.003 

gi = 0.673 ±0.003 and m = 0.2 ± 0.05 (89) 

i.e., although the fluctuations in the magnetization are large, it is clearly nonzero. 

Further support for a nonzero magnetization is given by simulation results: in figure 
E] we show simulation results for three values of the system size (N = 2000, N = 10, 000 
and N = 50,000), where we plot the magnetization versus the number of updates per 
spin up to 10 7 sequential Glauber updates. The results show strong finite size effects 
coupled with slow relaxation towards equilibrium, the latter point precluding simulations 
of larger systems. To check that the magnetizations were not just the result of very slow 
relaxation towards equilibrium, we ran simulations of an N = 2000 system for 50 x 10 6 
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updates per spin, and we started other simulations with small initial magnetization. 
In both cases we observed that the resulting long time magnetization was still w 0.25. 
The average magnetisation and the standard deviation (Am) over 10 independent runs 
(different realisation of both the thermal noise and disorder) gives 

iV = 10 000 : m av = 0.24 Am = 0.07 (90) 

N = 50 000 : m av = 0.25 Am = 0.03 (91) 

Thus we believe that the fluctuations within runs and between runs can both be 
put down to finite size effects. Although from the simulations performed so far the 
equilibrium value of the magnetisation in the thermodynamic limit cannot be determined 
with great accuracy, the 1RSB average value of m = 0.2 certainly seems more acceptable 
than the vanishing magnetisation result of RS theory. 

9. Conclusions 

In this paper we have applied the cavity approach to the 'small world' lattice model, 
previously studied using replica theory in |7| . The model is generalised to the case of an 
arbitrary (site independent) connectivity distribution for the random graph component 
of the lattice. Along the lines of [Oj, we have extended the RS results to the case of a 
1RSB formalism, which is numerically solvable with population dynamics algorithms. 
Furthermore, we have extended the replica formalism (based on replicated transfer 
matrices) at the level of 1RSB according to the Parisi-scheme and shown how it recovers 
exactly the functional order parameter equations of the cavity method. We applied the 
population dynamics algorithm to a model in which the random graph component has 
a connectivity distribution p(k) = S^e- We find support for the conjecture that the 
replica symmetric reentrance in the spin glass phase is non-physical: the ferromagnetic 
to spin glass phase boundary in 1RSB shifts into the spin glass region of the RS phase 
diagram. This result is supported by simulations. 

Possible extensions to this approach include examining the case where one has 
more neighbours along the spin chain, e.g. one could include next-nearest neighbour 
interactions which would increase the clustering effect in one dimension. This would 
lead to order parameters encompassing the joint distribution of effective fields. We are 
also investigating a model of XY spins on a 'small world' architecture, the continuous 
nature of the spins leads to interesting new behaviour and requires new techniques. 

Further stages of replica symmetry breaking although in principle attainable would 
of course have a prohibitive CPU cost. The exception is possibly at zero temperature, 
where expressions simplify and analysis can be pushed further, along the lines of recent 
papers as [THl EHJ ED]- There are of course many other disordered problems where 
the small world architecture is appropriate and the techniques presented here could be 
applicable. 
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